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Abstract. We study the question, "For which reals x docs there exist a mea- 
sure ji such that x is random relative to We show that for every nonre- 
cursive x, there is a measure which makes x random without concentrating 
on x. We give several conditions on x equivalent to there being continuous 
measure which makes x random. We show that for all but countably many 
reals x these conditions apply, so there is a continuous measure which makes 
x random. There is a meta-mathematical aspect of this investigation. As one 
requires higher arithmetic levels in the degree of randomness, one must make 
use of more iterates of the power set of the continuum to show that for all but 
countably many x's there is a continuous fi which makes x random to that 
degree. 



1. Introduction 

Most studies on algorithmic randomness focus on reals random with respect to 
the uniform distribution, i.e. the (1/2, l/2)-Bcrnoulli measure, which is measure 
theoretically isomorphic to Lcbcsguc measure on the unit interval. The theory of 
uniform randomness, with all its ramifications (e.g. computable or Schnorr ran- 
domness) has been well studied over the past decades and has led to an impressive 
theory. 

Recently, a lot of attention focused on the interaction of algorithmic randomness 
with recursion theory: What are the computational properties of random reals? In 
other words, which computational properties hold effectively for almost every real? 
This has led to a number of interesting results, many of which will be covered in a 
forthcoming book by Downey and Hirschfeldt [4]. 

While the understanding of "holds effectively" varied in these results (depending 
on the underlying notion of randomness, such as computable, Schnorr, or weak 
randomness, or various arithmetic levels of Martin-L6f randomness, to name only 
a few), the meaning of "for almost every" was usually understood with respect 
to Lcbesgue measure. One reason for this can surely be seen in the fundamental 
relation between uniform Martin-L6f tests and descriptive complexity in terms of 
(prefix-free) Kolmogorov complexity: A real is not covered by any Martin-Lof test 
(with respect to the uniform distribution) if and only if all of its initial segments 
are incompressible (up to a constant additive factor). 

However, one may ask what happens if one changes the underlying measure. 
This question is virtually as old as the theory of randomness. Martin-Lof [15] 
defined randomness not only for Lebesgue measure but also for arbitrary Bernoulli 
distributions. Levin's contributions in the 1970's [24, 11, 12, 13] extended this to 
arbitrary probability measures. He obtained a number of remarkable results and 
principles such as the existence of uniform tests, conservation of randomness, and 
the existence of neutral measures. 
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In this paper we will survey a recent line of research by the authors which dealt 
with the question for which reals x does there exist a probability measure which 
makes x random without concentrating on x. We consider two kinds measures - 
arbitrary probability measures, which may have atoms (reals other than x on which 
the measure concentrates), and continuous measures, i.e. non-atomic measures. 
The investigations exhibit an interesting, and quite unexpected, connection between 
the randomness properties of a real and its logical complexity, in the sense of 
recursion or set theoretic hierarchies. In the following we will try to describe this 
connection in some detail. We will sketch proofs to provide some intuition, but 
for a full account we have to refer the reader to the forthcoming research papers 
[19, 20]. 

2. Measures and Randomness 

In this section we introduce the basic notions of measure on the Cantor space 
2" and define randomness for arbitrary probability measures. 

The Cantor space 2" is the set of all infinite binary sequences, also called reals. 
The topology generated by the cylinder sets 

N a = {x : x \n = a}, 

where a is a finite binary sequence, turns 2^ into a compact Polish space. We will 
occasionally use the notation N(a) in place of N a to avoid multiple subscripts. 2 <u> 
denotes the set of all finite binary sequences. If a, r G 2 <UJ , we use C to denote the 
usual prefix partial ordering. This extends in a natural way to 2 <UJ U 2 W . Thus, 
x E N a if and only if a C x. Finally, given U C 2 <UJ , we write No to denote the 
open set induced by U, i.e. No = {J aeU N a . 

2.1. Probability measures. A probability measure on 2" is a countably additive, 
monotone function \i : "S — > [0, 1], where "5 C 3 (2") is cr-algebra and /u(2 w ) = 1. p, 
is called a Borel probability measure if 5F is the Borel cr-algebra of 2". It is a basic 
result of measure theory that a probability measure is uniquely determined by the 
values it takes on an algebra A C J that generates 3 r . It is not hard to see that the 
Borel sets are generated by the algebra of clopen sets, i.e. finite unions of basic open 
cylinders. Normalized, monotone, countably additive set functions on the algebra 
of clopen sets are induced by any function p : 2 <UJ — ► [0, 1] satisfying 

p(e) = l and p(a) = p(cr^0) + p(er~l) (2.1) 

for all finite sequences a. Then n(N a ) = p{a) yields an monotone, additive function 
on the clopen sets, which in turn uniquely extends to a Borel probability measure on 
2". In the following, we will deal exclusively with Borel probability measures, and 
hence we will identify such measures with the underlying function on cylinders sat- 
isfying (2.1), and write, in slight abuse of notation, fi(a) instead of fJ,(N a ). Besides, 
we will mostly speak of measures, understanding Borel probability measures. 

The Lebesgue measure £ on 2" is obtained by distributing a unit mass uniformly 
along the paths of 2 U , i.e. by setting £(cr) = 2~l a l. A Dirac measure, on the other 
hand, is defined by putting a unit mass on a single real, i.e. for i£2", let 




1 if a C x, 
otherwise. 
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If, for a measure \i and x £ 2", \i(\x\) > 0, then x is called an atom of fi. Obviously, 
x is an atom of S x - A measure that does not have any atoms is called continuous. 

3. Martin-Lof Randomness 

It was Martin-Lof 's fundamental idea to define randomness by choosing a count- 
able family of nullsets. For any non-trivial measure, the complement of the union 
of these sets will have positive measure, and any point in this set will be consid- 
ered random. There are of course many possible ways to pick a countable family 
of nullsets. In this regard, it is very benefiting to use the framework of recursion 
theory and effective descriptive set theory. 

3.1. Nullsets. Before we go on to define Martin-Lof randomness formally, we note 
that every nullset is contained in a G^-nullsct. 

Proposition 3.1. Suppose fi is a measure. Then a set A C 2" is fi-null if and 
only if there exists a set f/CNx 2 <UJ such that for all n, 

A C N(U„) and M-^) < 2 _n , (3.1) 

v£U n 

where U n = {a : (rt, cr) 6 U}. 

Of course, the G^-cover of A is given by (~) U n . 

3.2. Martin-Lof tests and randomness. Essentially, a Martin-Lof test is an 
effectively presented G$ nullset (relative to some parameter z). 

Definition 3.2. Suppose z £ 2 W is a real. A test relative to z, or simply a z-test, is 
a set W C N x 2 <UJ which is recursively enumerable in z. Given a natural number 
n > 1, an n-test is a test which r.e. in 0(™ _1 ), the (n — l)st Turing jump of the 
empty set. A real x passes a test W if x £ f] n N(W n ). 

Passing a test W means not being contained in the Gg set given by W. The 
condition 'r.e. in z 1 implies that the open sets given by the sets W n form a uniform 
sequence of sets, and the set f] n N(W n ) is a Il^z) subset of 2"\ 

To test for randomness with respect to a measure, we have to ensure two things: 
First that a test W actually describes a nullset. Second, that the information 
present in a measure is available to the test. Te first criterion we call correctness. 

Definition 3.3. Suppose ^ is a measure on 2". A test W is correct for fi if 

E fiNr) < 2"™. (3.2) 

To incorporate measures into an effective test for randomness we have to repre- 
sent it in a form that makes it accessible for recursion theoretic methods. Essen- 
tially, this means to code a measure via an infinite binary sequence or a function 
/ : N — > N. Unfortunately, there are many possible such representations. Hence, 
strictly speaking, we will deal with randomness with respect to a representation of 
a measure, not the measure itself. However, we will see that for one of our main 
topics, randomness for continuous measures, representational issues can be resolved 
quite elegantly. 

The most straightforward representation of a measure is the following. 
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Definition 3.4. Given a measure p, define its rational representation r p by letting, 
for all a G 2 <w , qi,q 2 G Q, 

(o-,qi,q 2 ) G r p gi < p(er) < g 2 - (3.3) 

The rational representation does not reflect the topological properties of the 
space of probability measures on 2" . The space of probability measures V on 2" is 
a compact polish space (see Parthasarathy [17]). The topology is the weak topology, 
which can be metrized by the Prokhorov metric, for instance. There is an effective 
dense subset, given as follows: Let Q be the set of all reals of the form er^O". 
Given q = (qi, . . . , q n ) G Q <UJ and non-negative rational numbers a\, . . . ,a n such 
that oti = 1 , let 

n 
k=l 

where S x denotes the Dirac point measure for x. Then the set of measures of the 
form bq is dense in P. 

The recursive dense subset {i5g} and the effectiveness of the metric d between 
measures of the form Sq suggests that the representation reflects the topology ef- 
fectively, i.e. the set of representations should be H®. However, this is not true 
for the set of rational representations of probability measures. Instead, we have 
to resort to other representations in metric spaces, such as Cauchy sequences. Us- 
ing the framework of effective descriptive set theory, as for example presented in 
Moschovakis [16], one can obtain the following. 

Theorem 3.5. There is a recursive surjection 

7T : 2" -> P 

and a subset P of 2^ such that it \P is one-one and tt(P) = P. 

In the following sections, we will always assume that a measure is either rep- 
resented by its rational representation or via the the set ? C 2" of the previous 
theorem. The definition of randomness, however, works for any representation. 

Definition 3.6. Suppose p is a probability measure on 2", p M G 2" is a represen- 
tation of p, and z G 2" is a real. A real is Martin-Ldf n-random for p relative to 
and z, or simply (n, z) -random for p p if it passes all (p^ © z)( n-1 )-tests which 
are correct for p. 

If the representation is clear from the context, we speak of (n, z)-randomness for 
p. If p is Lebcsgue measure £, we drop reference to the measure and simply say 
LL x is (n, z)-random" . We also drop the index 1 in case of (1, ,z)-randomness and 
simply speak of "randomness relative to z" or z-randomness. 

Since there are only countably many Martin-L6f n-tests, it follows from countable 
additivity that the set of Martin-L6f n-random reals for p has p- measure 1. Hence 
there always exist (n, z)-random reals for any measure p. 

3.3. Image measures and conservation of randomness. One can obtain new 
measures from given measures by transforming them with respect to a sufficiently 
regular function. Let / : 2" — > 2" be a Borel (measurable) function, i.e. for every 
Borel set A, f~ 1 (A) is Borel, too. If p is a measure on 2" and / is Borel, then the 
image measure pf is defined by 

p f (A) = p(f- 1 (A)). 
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It can be shown that every probability measure can be obtained from Lebesgue 
measure £ by means of a measurable transformation. 

Theorem 3.7 (folklore, sec e.g. Billingsley [1]). If ji is a Borel probability measure 
on 2^ ' , then there exists a measurable f : 2" — » 2" such that \l = Lf. 

If the transformation of £ is effective, then / maps an £.-random real to a Lf- 
random real. This principle is called conservation of randomness, first introduced 
by Levin. We can use it to construct measures for which a given real is random, as 
we will see in the next sections. 

4. Randomness of Non-Recursive Reals 

If x is an atom of some probability measure /it, it is trivially /x-random. Interest- 
ingly, the recursive reals are exactly those for which this is the only way to become 
random. 

Theorem 4.1 (Rcimann and Slaman [20]). For any realx, the following are equiv- 
alent. 

(i) There exists a (representation of a) probability measure fj, such that [i({x}) = 

and x is [i-random. 
(ii) x is not recursive. 

Proof sketch. If x is recursive and /* is a measure with [i({x}) = 0, then we can 
obviously construct a fi-test that covers x, by computing (recursively in fj,) the 
measure of initial segments of x, which tends to 0. 

Now assume x is not recursive. A fundamental result by Kucera [10] ensures 
that every Turing degree above 0' contains a £-random real. This result relativizcs. 
Hence one can combine it with the Posner- Robinson Theorem [18], which says that 
for every non-recursive real x there exists a z such that x ® z =t z' . This way we 
obtain a real R which is 

(1) £-random relative to some z G 2 U , and 

(2) T(z)-cquivalent to x. 

There are Turing functionals $ and recursive in z such that 

$(i?) = x and $(x) = R. 

We can use the functionals to define a class of measures that are possible candidates 
to render x random. Given u £ 2 U , define the set Pre((r) to be the set of minimal 
elements of 

{t S 2 <u : $(r) D a and *(cr) C r}. 
We define a set of measures M by requiring that /i G M if and only if 

Va[£(Prc(cr)) < ^(<r) < £(*(cr))]. (4.1) 

The first inequality ensures that \i dominates an image measure induced by $. This 
will ensure that any Martin-L6f random real is mapped by <f> to a /i-random real. 
The second inequality guarantees that [i is non-atomic on the domain of <J . 

One can show the topological representations of the measures in M (Theorem 
3.5) form a non-empty Vl{ class M in 2" relative to z. 

In order to apply conservation of randomness, we have to know that one of 
the measures in M, when given as an additional information to a £/-test, will not 
destroy the randomness of R. This is ensured by the following basis result for 11° 
sets regarding relative randomness (essentially a consequence of compactness). □ 
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Theorem 4.2 (Reimann and Slaman [20], Downey, Hirschfeldt, Miller, and Nies 
[3]). Let S be Tv[(z). If R is SL-random relative to z, then there exists y € S such 
that R is Z-random relative to y © z. 

5. Randomness for continuous measures 

A natural question arising in the context Theorem 4.1 is whether the measure 
making a real random can be ensured to have certain regularity properties; in 
particular, can it be chosen continuous'? 

Reimann and Slaman [20] gave an explicit construction of a non-recursive real 
not random with respect to any continuous measure. Call such reals 1-ncr. In 
general, let NCR„ be the set of reals which are not n-random with respect to any 
continuous measure. 

Kjos-Hanssen and Montalban [8] observed that any member of a countable III 
class is an element of NCRi . 

Proposition 5.1. If A C 2 U is III an d countable, then no member of A can be in 
NCRi. 

Proof idea. If /x is a continuous measure, then obviously n(A) = 0. One can use a 
recursive tree T such that [T] = A to obtain a /x-test for A. □ 

It follows from results of Cenzer, Clote, Smith, Soare, and Wainer [2] that mem- 
bers of NCRi can be found throughout the hyperarithmetical hierarchy of A}, 
whereas Kreiscl [9] had shown earlier that each member of a countable class is 
in fact hyperarithmetical. 

Quite surprisingly, A} turned out to be the precise upper bound for NCRi. An 
analysis of the proof of Theorem 4.1 shows that if x is truth-table equivalent to 
a iL-random real, then the "pull-back" procedure used to devise a measure for x 
yields a continuous measure. More generally, we have the following. 

Theorem 5.2 (Reimann and Slaman [20]). Let x be a real. For any z £ 2 U and 

any n > 1, the following are equivalent. 

(i) x is (n, z)-random for a continuous measure fi recursive in z. 

(ii) x is (n, z) -random for a continuous dyadic measure v recursive in z. 
(Hi) There exists afunctional <f> recursive in z which is an order-preserving home- 
omorphism of 2" such that is (n, z)-random. 

(iv) x is truth-table equivalent relative to z to a (n, z) -random real. 

Here dyadic measure means that the values of fj, on the open cylinders are of the 
form fx(o~) — to/2" with to, n £ N. The theorem can be seen as an effective version 
of the classical isomorphism theorem for continuous probability measures (see for 
instance Kechris [7]). 1 

Woodin [23] , using a variation on Prikry forcing, was able to prove that if x £ 2" 
is not hypcrarithmctic, then there is a z £ 2" such that x © z =tt( z ) z \ i- e - outside 
A} the Posner-Robinson theorem holds with truth-table equivalence. Hence we can 
infer the following result. 

Theorem 5.3 (Reimann and Slaman [20]). If a real x is not A}, then there exists 
a continuous measure fi such that x is fj.-random. 



The theorem suggests that for continuous randomness representational issues do not really 
arise, since there is always a measure with a computationally minimal representation. 
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It is on the other hand an open problem whether every real in NCRi is a member 
of a countable II® class. 

One may ask how the complexity and size of NCR„ grows with n. It turned out 
all levels of NCR are countable. 

Theorem 5.4 (Reimann and Slaman [19]). For all n, NCR„ is countable. 

Proof idea. The first step is to use Borel determinacy to show that the complement 
of NCR ra contains an upper Turing cone. This follows from the fact that the 
complement of NCR„ contains a Turing invariant and cofinal (in the Turing degrees) 
Borel set, which can be seen as follows. 

If for two reals x,y, x =t(z) Ui then x =tt( z ') V- Suppose x =t(z) R where R is 
(n + l)-random relative to z. Then, since R is n-random relative to z' ', it follows 
from Theorem 5.2 that x is random with respect to some continuous measure. 

So if we let B C 2" be the set 

{x £ 2 W : 3z 3R (x =t z © R & R is (n + l)-random relative to z)}, 

B is a Turing invariant Borel set cofinal in the Turing degrees. It follows from Borel 
Determinacy [14] that B contains an upper cone in the Turing degrees. 

The next step is to show that the elements of NCR„ show up at a countable level 
of the constructible universe L. It holds that NCR n C Lp n , where (3 n is the least 
ordinal such that 

L 0n H ZFC n: 

where ZFC~ is ZFC with the power set axiom replaced by the existence of n iterates 
of the power set of u>. Note that Lp n is the level of constructibility capturing 
Martin's construction of a winning strategy in a S^-game. 

Given x ^ Lp n , construct a set G such that Lp n [G] is a model of ZFC~ , and for all 
V e Lp n [G](12 UJ , y <t x®G. G is constructed by Kumabe- Slaman forcing (see [22]). 
This notion of forcing provides a method to extend the Posner-Robsinson Theorem 
to higher levels of the jump and beyond. The existence of G allows to conclude: If a; 
is not in Lp n , it will belong to every cone with base in Lp n [G]. In particular, it will 
belong to the cone given by the Borel Turing determinacy argument (relativized 
to G, here one has to use absoluteness), i.e. the cone avoiding NCR„. Hence x is 
random relative to G for some continuous /i, an thus in particular //-random. □ 

The proof of the countability of NCR„ makes essential use of Borel determinacy. 
It is known from a result by Friedman [5] that the use of wi-many iterates of 
the power set of u> are necessary to prove Borel determinacy. In the simplest 
case, Friedman showed that ZFC~ does not prove the statement "All Sg-games on 
countable trees are determined." The proof works by showing that there is a model 
of ZFC~ for which Sg-determinacy does not hold. This model is just Lp . The 
analysis extends to higher levels of the Borel hierarchy, applying to more and more 
iterates of the power set. 

The question suggests itself whether the proof of the countability of NCR„ re- 
quires a similar set theoretic complexity 

Theorem 5.5 (Reimann and Slaman [19]). For every k, the statement 

For every n, NCR„ is countable, 
cannot be proven in ZFCJ7. 
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Proof sketch. We show that for every fixed k, some NCR„ is cofinal in the Turing 
degrees of Lp k . In fact, Jensen's master codes [6] for L, the universe of constructible 
sets, are the cofinal set. 

L is generated by transfinite recursion in which the recursion steps are closing 
under first order definability and forming unions. The master codes represent the 
initial segments of L and are generated by iterating the Turing jump and taking 
L-least representations of direct limits. In short, a master code is either definable 
relative to an earlier master code or is the code for the well-founded limit of struc- 
tures each of which is coded by an earlier master code. The number of iterates 
of the power set present in the initial segment of L which is being coded is linked 
to the complexity of describing the direct limit used to form its master code. For 
a less than [3^, there is a fixed bound on this complexity. We let M a denote the 
master code for Lp. 

Neither of these cases is consistent with randomness, as indicated by the following 
lemmas. 

Lemma 5.6. Suppose that n > 2, y £ 2", and x is n-random for \x. If i < n, y is 

recursive in (x © fi) and recursive in fjy', then y is recursive in fi. 

Lemma 5.7. Suppose that x is (n + 5) -random for [i, -< is a linear ordering that is 
A„ , i relative to [i, and I is the largest initial segment of -< which is well-founded. 
If i < n and I is in (x © (J,), then I is recursive in fi. 

Suppose a less than (3k and a continuous measure fi arc given so that M a is 
random relative to fi. Heuristically, we argue as follows. We proceed by induction on 
(3 < a to prove that Mp is recursive in fi. If (3 is a successor, then Mp is arithmetic 
in some earlier master code, with a uniform upper bound on the complexity of the 
definition depending on fc. Then, Mp is uniformly arithmetic in /i and recursive in 
M a , Lemma 5.6 applies. Otherwise, Mp is the well-founded direct limit of structures 
recursive in \i and recursive in in M a , so Lemma 5.7 applies. In either case, Mp 
is recursive in fi. By induction, M a is itself recursive in fj, and not /i-random, a 
contradiction. □ 
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